r 


I 

V 

t 


l| 


[ 


o 

00 

00 


APPROVED  FOR  PUBLIC  RELEASE,  DISt^»UX^ON  UNLIMITED 

ALEX(01)TR-7l-04 


NETWORK  CAPABILITY  ESTIMATION 
TECHNICAL  REPORT  NO.  4 

VEU  NETWORK  EVALUATION  AND  AUTOMATIC  PROCESSING  RESEARCH 

Prepared  by 
Nolan  S.  Snell 


TEXAS  INSTRUMENTS  INCORPORATED 
Equipment  Group 
Post  Office  Box  6015 
Dallas,  Texas  75222 


Prepared  for 

AIR  FORCE  TECHNICAL  APPLICATIONS  CENTER 
Alexandria,  Virginia  22314 


Sponsored  by 

ADVANCED  RESEARCH  PROJECTS  AGENCY 
Nuclear  Monitoring  Research  Office 
ARPA  Program  Code  No.  6F10 
ARPA  Order  No.  2551 


24  September  1976 


Acknowledgment:  This  research  was  supported  by  the  Advanced 

Research  Projects  Agency,  Nuclear  Monitoring  Research  Office, 
under  Project  VELA-UNIFORM  and  accomplished  under  the  tech- 
nical direction  of  the  Air  Force  Technical  Applications  Center 
under  Contract  Number  F08606-76-C-001 1. 


COPY  AViHUttE  TO  DDC  POES  IWT 
PERMIT  FIR^  im£  PSOIIilCTION 


Cquipm0nt  Group 


I 


APPROVED  FOR  PUBLIC  RELEASE,  DISTRIBUTION  UNLIMITED 


ALEX(01)-TR-76-04 


NETWORK  CAPABILITY  ESTIMATION 


TECHNICAL  REPORT  NO.  4 

VELA  NETWORK  EVALUATION  AND  AUTOMATIC  PROCESSING  RESEARCH 


Prepared  by 
Nolan  S,  Snell 


TEXAS  INSTRUMENTS  INCORPORATED 
Equipment  Group 
Post  Office  Box  6015 
Dallas,  Texas  75222 


•Prepared  for 

AIR  FORCE  TECHNICAL  APPLICATIONS  CENTER 
Alexandria,  Virginia  22314 


Sponsored  by 

ADVANCED  RESEARCH  PROJECTS  AGENCY 
Nuclear  Monitoring  Research  Office 
ARPA  Program  Code  No.  6F10 
ARPA  Order  No.  2551 


24  September  1976 


Acknowledgment:  This  research  was  supported  by  the  Advanced 

Research  Projects  Agency,  Nuclear  Monitoring  Research  Office, 
under  Project  VELA*UNIFORM  and  accomplished  unde<  the  tech- 
nical direction  of  the  Air  Force  Technical  Applications  Center 
under  Contract  Number  F08606-76-C-001 1. 


Equipment  Group 


UNCLASSIFIED 


secumTv  ct*ssiriCATiow  or  this  ^age  o«««  gncf^j 

REPORT  DOCUMENTATION  PAGE  before“cSSJle"ng”  orm 

I."  report  number  b GOVT  ACCESSION  NO  * ^ECl^ieNT’S  CATALOG  NUMBER 


I 4.  TITLE  (mtd  Subtlllm) 


[NETWORK  CAPABILITY  ESTIMAilON 


^jcixr  /t 


Nolan  S.^/Snell  j 

#1  BEWEUWWimi  Ow'llIWl  ITi  ION  name  and  AODHEtS 

Texas  Instruments  Incoroorated 
Equipment  Group 

Dallas,  Texas 75Z2Z 

I*  CONTROLLING  OFElCE  NAME  AND  ADDRESS 

Advanced  Research  Projects  Agem  y 
Nuclear  Monitoring  Research  Offii  e 
Arlington,  Virginia Z2Z  09 


msjKWbti « wvmavKi 

C Technical  / 


»ALEX(131)-TR-76-04 


Fj08h06-76-C-4011< 


WORK  UNIT  numbers 


VELA  T/6705/B/ETR 


|24  Set 


monitoring  AGENCY  NAME  • ADDRESS^'// tnm  ConlnlUng  Olllct)  I IS.  SECURITY  CLASS,  fol  inlTr^ 


Air  Force  Technical  Applications  Center 
VELA  Seismological  Center 
Alexandria,  Virginia  22314 


UNCLASSIFIED 

ISa.  DECLASSIFICATION  downgrading' 

schedule 


I IS.  OISTRiauTlON  STATEMENT  fet  Ihim  ntpott) 


APPROVED  FOR  PUBLIC  RELEASE,  DISTRIBUTION  UNLIMITED 

t7.  DISTMI0UTION  STATEMENT  (ot  tiff  4 in  Block  30,  It  4UtofM  from 


I 11.  SUAALCMENTAAY  notes 


ARPA  Order  No.  2551 


I If.  KEY  WOAOS  fCofiUnuo  on  fvoroo  ot4o  It  noeoooofy  «n<#  l4ontlty  ky  block  nuoibor) 


Seismology 

Threshold  Magnitude  Estimation 
Network  Detection  Capability 
Station  Ranking 


20!'^4P$TAACT  fConilnuo  on  fvoroo  oi4o  If  nocoooory  ond  l4ontlfy  by  block  ouoibor; 


^X^NET WORTH  is  a computer  program  which  calculates  the  detection 
and  location  capability  of  seismic  networks.  A modified  version  of 
NETWORTH  has  been  developed.  This  program  has  been  used  to  evaluate 
the  effect  of  station  'downtime',  the  signal  amplitude  variance,  and  the  sta- 
tion detection  threshold  upon  network  detection  caoability.  In  this  version 
all  parameters  may  be  cha.nged  separately  for  individual  stations.  The  


DO  i^Sr,  1473  EDITION  or  I NOV  •*  IS  OBSOLETE 


sly  for  individual  stations.  The  ^ 



UNCLASSIFIED 

security  CLASSIEICATION  OE  THIS  RAOC  cMtim  Dal*  Enlarrrt)  , 


UNCLASSIFIED 


StCuniTV  CLAUIFICATION  OF  THIS  FAOCOIh«n  Dtm  Enl»nd) 


cO*V 


20.  continued 

capability  of  using  signal  amplitude  corrections  has  been  added.  The  func- 
tion of  amplitude  corrections  is  to  remove  possible  bias  in  the  magnitude 
estimate  due  to  inhomogeneous  signal  attenuation.  These  corrections  may 
be  applied  to  individual  stations,  --idividual  epicenters,  or  individual  sta- 
tion/epicenter combinations.  An  option  has  been  added  to  calculate  the 
effect  of  station  'downtime'  upon  network  caoability. 

This  study  indicates  that,  if  capability  loss  due  to  detection  errors 
can  be  minimized,  then  station  detection  threshold  and  station  reliability 
will  be  the  fundamental  limits  to  network  performance.  A baseline  net- 
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NETWORTH  is  a computer  program  which  calculates  the  detec- 
tion and  location  capability  of  seismic  networks.  A modified  version  of 
NETWORTH  has  been  developed.  This  program  has  been  used  to  evaluate  the 
effect  of  station  'downtime',  the  signal  amplitude  variance,  and  the  station  de- 
tection threshold  upon  network  detection  capability.  In  this  version  all  param- 
eters may  be  changed  separately  for  individual  stations.  The  capability  of  us- 
ing signal  amplitude  corrections  has  been  added.  The  function  of  amplitude 
corrections  is  to  remove  possible  bias  in  the  magnitude  estimate  due  to  in- 
homogeneous signal  attenuation.  These  corrections  may  be  applied  to  individ- 
ual stations,  individual  epicenters,  or  individual  station/ epicenter  combina- 
tions. An  option  has  been  added  to  calculate  the  effect  of  station  'downtime' 
upon  network  capability. 

This  study  indicates  that,  if  capability  loss  due  to  detection  er- 
rors can  be  minimized,  then  station  detection  threshold  and  station  reliability 
will  be  the  fundamental  limits  to  network  performance.  A baseline  network  of 
thirteen  stations  has  been  used  for  this  study,  and  a preliminary  evaluation  of 
these  stations  has  been  performed.  These  stations  are  as  follows:  Alaskan 
Long  Period  Array,  (ALPA);  Ankara,  (ANK);  Chiang  Mai,  (CHG);  Korean  Seis- 
mic Research  Station,  (KSRS);  Large  Aperture  Seismic  Array,  (LASA);  Mash- 
had, (MSH);  Mundaring,  (MUN);  Nor^^regian  Seismic  Array,  (NORSAR);  New 
Delhi,  (NWDEL);  Red  Knife,  Ontario,  (RK-ON);  Shillong,  (SHL);  Taipei,  (TAP); 
and  White  Horse,  Yukon,  (WH-YK). 
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SECTION  1 
INTRODUCTION 


NETWORTH  is  a computer  orogram  which  estimates  the  de- 
tection and  location  capability  of  seismic  networks  (Wirth,  1971).  Given  sta- 
tion parameters  and  epicenters,  both  network  detection  threshold  magnitudes 
and  location  confidence  regions  are  computed.  The  output  is  presented  in 
tabular  format  and  also  plotted  on  a world  map  (via  NETPLOT). 

Using  a modified  version  of  NETWORTH,  the  individual  effect 
of  certain  parameters  upon  network  performance  has  been  determined.  These 
modifications  are  intended  to  provide  a more  realistic  network  evaluation.  The 
results  of  this  evaluation  are  presented  in  Section  II.  The  two  sections  follow- 
ing that  contain  a criticism  of  the  assumptions  implicit  in  the  NETWORTH  pro- 
gram (Section  III),  and  the  conclusions  and  recommendations  from  this  study 
(Section  IV).  An  analysis  of  the  individual  stations  comprising  this  network 
is  included  in  Appendix  A.  The  modifications  to  NETWORTH  are  documented 
in  Appendix  B. 
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SECTION  II 
PARAMETER  STUDY 


A.  BACKGROUND 

The  purpose  of  this  study  was  to  evaluate  the  effect  of  certain 
paranaeters  upon  the  detection  capability  of  a seismic  network.  Here  detec- 
tion capability  is  defined  as  the  lowest  magnitude  at  which  the  probability  of 
four  station  detections  exceeds  90  percent.  The  parameters  investigated 
include  the  station  detection  threshold,  the  station  reliability,  and  the  signal 
amplitude  variance.  Since  these  parameters  individually  have  a wide  range, 
the  following  plan  was  followed.  A baseline  network  was  established  using 
station  noise  statistics  furnished  by  Rothman  (1976,  personal  communication). 
A baseline  value  of  0.  4 was  used  for  the  standard  deviation  of  the  logjQ  signal 
amplitude  in  magnitude  units).  Veith  and  Clawson  (1972)  determined  that 

this  value  of  (T  was  representative  of  the  WWSSN  short-period  network.  A 

s 

baseline  value  of  4.0  was  used  for  the  station  detection  threshold  (signal-to 
noise  ratio  required  for  detection).  This  detection  threshold  is  used  at  NOR- 
SAR  for  conventional  beamforming  (Ringdal,  1972).  The  stations  in  the  base- 
line network  were  assumed  "up"  at  all  times.  Each  parameter  being  tested 
was  varied  individually  from  the  baseline  value,  and  the  resulting  change  in 
network  detection  capability  was  calculated.  This  plan  has  the  advantages  of 
determining  the  effect  of  each  parameter  uniquely  and  reducing  the  number 
of  test  runs. 

The  NETWORTH  technique  for  estimating  network  detection 
capability  is  based  on  the  equations  summarized  in  Table  II-l.  First,  the 
signal  amplitudes  at  all  network  stations  are  calculated  for  an  assumed  event 
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TABLE  II- 1 


EVALUATION  OF  NETWORK  DETECTION  CAPABILITY 
THRESHOLD  MAGNITUDE  DETERMINATION 


log, -A..  = m.  + b.  + CAlog,-A..  + E.. 
®10ij  j A A*10ij  ij 


p. . = ^ 

U 


</>(x)  = 


/ 2 2\i/: 

fa  + CT  ) 

V ti  s/ 


iV/ 


X 2 
-y^/2 


dy 


Pj(>a) 


(II- 1) 
(II-2) 

(II- 3) 
(II-4) 


Symbols  above  are  defined  as  follows: 

Aj.  - signal  amplitude  at  station  i for  event  j (0-p) 
mj  - magnitude  of  event  j (m^^) 

^A*  ^A  ~ standard  table  entries 

- station-epicenter  bias  corrections 

- mean  log^Q  noise  amplitude  (0-p) 

- variance  of  logjQ  noise 

- variance  of  log|Q  signal 

- normal  cumulative  probability  function 

- number  of  stations  in  the  network 

- probability  that  k stations  will  detect  event  j 

Pj(>  a)  - probability  that  a or  more  stations  will  detect  event  j 

SDT  - station  detection  threshold;  i.  e. , signal-to-noise  ratio  re 
quired  for  detection  at  station. 


Eij 


N 

Pj(k) 
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at  epicenter  j with  magnitude  m (equation  (II-l)).  The  calculation  of  the 

DJ 

signal  amplitudes  uses  a standard  distance -amplitude  table  based  upon  Claw- 
son P-wave  values.  Signal  and  noise  are  assumed  lognormally  distributed  in 
NETWORTH;  hence  the  probability  that  the  signal -to -noise  ratio  exceeds  the 
station  detection  threshold  is  given  by  the  normal  cumulative  probability 
function  (equations  (II-2)  and  (II-3)).  In  NETWORTH  signal  and  noise  are 
recorded  zero -to -peak  (0-p).  The  noise  mean  is  input  as  the  geometric  mean 
of  the  noise  amplitudes:  the  logarithm  of  the  geometric  mean  gives  the  mean 
logarithm  (base  10)  of  the  noise,  The  individual  station  detection  proba- 

bilities are  then  combined  into  the  network  probability  of  at  least  a station 
detections,  Pj(>a),  using  a recursive  relation  involving  the  individual  station 
detection  probabilities  (equation  (II-4)).  If  the  network  probability  of 
detections  is  less  than  the  required  probability  P , the  event  magnitude 

IN  £•>  X 

(m,  .)  is  incremented  and  the  loop  is  reentered.  The  lowest  event  magnitude 

^ til 

m^j  at  which  p^(>a)  is  threshold  magnitude  for  the  j epi- 

center. 


The  baseline  network  was  found  to  be  adequate  in  locating 
events  within  Eurasia.  This  is  evident  from  Figure  II-l,  in  which  the  orient- 
ed crosses  represent  the  95  percent  confidence  ellipses  for  zero  depths.  The 
calculation  of  confidence  regions  is  based  upon  the  estimated  travel  time  vari- 
ance, which  has  an  individual  station  component  and  a station-epicenter  com- 
ponent derived  from  a standard  table  (Wirth,  1971).  Each  station  was  as- 
sumed to  have  a standard  deviation  of  1.0  second  in  timing  the  signals.  These 
confidence  regions  are  elliptical  since  the  derivatives  of  the  travel  time  var- 
iance with  respect  to  latitude  and  longitude  are  in  general  not  equal;  varying 
with  the  epicenter/network  configuration.  Hence  there  exists  for  a required 
confidence  region  a direction  of  maximum  location  uncertainty  and  a direction 
of  minimum  location  uncertainty;  these  are  indicated  by  the  semi -major  and 
semi-minor  axes  of  the  95  percent  confidence  regions.  The  confidence 
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TABLE  11-2 
BASELINE  NETWORK 


Station 

Latitude 

°N 

Longitude 

Noise** 

Amplitude 

Noise* 
S.  D. 

ALPA 

65.2 

147.7 

0.78 

0.  10 

ANK 

39.  9 

-32.  8 

1.  03 

0.25 

CHG 

18.  8 

99.  0 

1.  03 

0.  15 

KSRS 

35.  5 

-127.  9 

1.50 

0.  22 

LAS  A 

46.  7 

106.  2 

0.40 

0.  15 

MSH 

36.  3 

-59.  6 

1. 70 

0.  35 

MUN 

32.  0 

-116. 2 

1.  11 

0.20 

NORS 

60.  8 

-10.  8 

1.  00 

0.  15 

NWDEL 

28.7 

-77.  2 

2.  00 

0.20 

RK-ON 

50.8 

93.7 

2.  50 

0.  50 

SHL 

25.  6 

-91.  9 

2.  00 

0.20 

TAP 

25.  0 

-121.  5 

3.47 

0.25 

WH-YK 

60.7 

1 

135.  0 

2.  50 

0.  50 

* S.  D.  = Standard  Deviation  (magnitude  units) 

**  Mean  (millimicrons,  0-p) 
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FIGURE  n-1 

95%  CONFIDENCE  REGIONS  - BASELINE  NETWORK 
(Crosses  Represent  Ellipse  Axes) 
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regions  are  centered  upon  the  known  epicenters.  An  event,  occurring  at  each 
epicenter  with  magnitude  equal  to  the  network  threshold  magnitude,  will  be 
located  for  a required  location  probability  p within  p 's  error  ellipse. 

Event  detection  capability,  here  defined  as  the  network  thresh- 
old magnitude,  is  contoured  in  Figure  II-2.  This  network,  using  the  baseline 
values  for  the  parameters  under  investigation,  has  a capability  between  m^ 

4.  2 and  m.  4.  4 for  Eurasia.  A contour  increment  of  0.  2 m,  is  used  for  all 
b b 

contour  plots  in  this  report.  The  effect  of  certain  parameters  upon  detection 
capability  has  been  investigated  in  this  study,  in  contrast  to  location  capabil- 
ity, since  the  dependence  of  the  latter  upon  travel  time  variance  is  well 
known.  The  next  section  presents  the  results  of  this  investigation. 

B.  RESULTS  FOR  INDIVIDUAL  PARAMETERS 
1.  Station  Detection  Threshold 

The  first  parameter  tested  was  the  station  detection  threshold; 
i.  e.  , the  signal-to-noise  ratio  required  for  detection  at  each  station.  In  the 
modified  NETWORTH  (NET  2),  the  station  detection  threshold  (SDT),  may  be 
varied  for  each  station.  This  option  was  not  utilized  in  this  study,  however, 
since  the  relevant  data  were  not  available.  Test  SDT's  varied  from  1.  5 to 
5.0  with  4.0  as  the  baseline  SDT;  the  resulting  detection  capabilities  are 
contoured  in  Figures  II-3  through  II-9. 

Examination  of  the  threshold  magnitudes  for  each  epicenter 
revealed  the  following  principles.  The  change  in  network  threshold  magnitude 
due  to  a change  in  SDT  from  SDT^  and  SDT^  was  found  to  be  independent  of 
epicenter  and  to  equal  m^  = log^Q  (SDT^/SDT^).  This  agrees  with  equations 
(II-l)  and  (II-2),  from  which  it  is  seen  that  for  a given  detection  probability  a 
change  in  the  logjg  (SDT)  if  equivalent  to  an  opposite  change  in  threshold  mag- 
nitude, m^,  for  all  epicenters.  Thus  the  probability  that  each  station  detects 
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FIGURE  II- 3 

THRESHOLD  MAGNITUDE  (m  : 3.8  - 6.6): 
STATION  DETECTION  THRESHOLD  =1.5 
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FIGURE  II-8 

THRESHOLD  MAGNITUDE  (m  : 4.4  - 6.  8): 
STATION  DETECTION  THRESHOLD  = 4.  5 
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FIGURE  II-9 


at  the  threshold  magnitude  was  unaffected  by  changing  the  SDT  at  a network 
level.  If  the  individual  stations  are  ranked  according  to  the  probability  that 
each  will  detect  at  the  threshold  magnitude,  then  changing  the  SDT  at  a net- 
work level  alters  the  threshold  magnitude  by  a constant  but  has  no  effect  upon 
the  relative  ranking  of  the  stations. 

2.  Station  Reliability 

For  each  station,  reliability  is  defined  as  the  probability  that 
the  station  is  up.  The  earlier  NE  i WORTH  implicitly  assumed  that  all  sta- 
tions were  always  up;  this  assumption  results  in  an  over-estimate  of  network 
capability.  In  NET  2 the  station  detection  orobability  has  been  made  a condi- 
tional probability,  the  probability  that  a station  will  detect  the  event  if  the 
station  is  up.  Although  reliabil  ty  is  a station  variable  in  NET  2,  such  data 
were  unavailable  at  a station  level.  Therefore,  test  reliabilities  were  as- 
signed at  a network  level,  i.  e.  , the  same  test  reliabilities  were  used  for  all 
the  stations.  In  Figure  II-IO,  Eurasian  capability  loss  is  plotted  against 
corresponding  reliabilities. 

This  plot  is  based  on  Eurasia  because  the  baseline  network 
provides  the  best  coverage  for  Eurasian  surveillance.  The  natural  redundancy 
of  such  a network  means  that  the  capability  loss  (due  to  station  downtime)  will 
increase  as  the  epicenter  moves  radially  away  from  the  network  center.  Ac- 
cordingly, for  each  value  of  reliability,  there  corresponds  a range  in  capabil- 
ity loss.  The  Eurasian  portion  of  this  range  appears  in  Figure  II-IO.  Fig- 
ures II-ll  and  11-12  represent  threshold  magnitudes  for  reliabilities  of  0.  65 
and  0.  80,  respectively. 

3.  Signal  Amplitude  Variance 

World-wide  bodywave  magnitudes  of  a given  event  are  assumed 

2 

to  follow  a Gaussian  distribution  with  unknown  mean  fl  and  variance  (T 
(Herrin  and  Tucker,  1972).  This  is  supported  by  a study  done  by  Freedman 
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FIGURE  II- 10 

RANGE  OF  CAPABIUTY  LOSS  (m^^)  FOR  EURASIAN  CONTINENT 
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FIGURE  11-12 

THRESHOLD  MAGNITUDE  (m  ; 4.  4 - 6.8): 
NETWORK  reliability  = 0.8 


(1967).  Freedman  showed  that  .he  amplitude  distribution  of  bodywave  record- 
ings was  closely  approximated  hy  a lognormal  distribution;  therefore,  the 
estii  lated  magnitude  has  a norn  al  distribution.  Lacoss  (1972)  has  shown 
that  noise  also  fits  a lognormal  iistribution.  These  results  are  incorporated 

into  the  NETWORTH  program  ii  that  both  signal  and  noise  are  assumed  log- 

2 

normally  distributed.  The  signal  amplitude  variance,  a , in  NETWORTH  is 

s 

assumed  independent  of  event  rr  igritude.  This  agrees  with  the  results  of 
Bungum  and  Husebye  (1974)  in  their  comparison  of  NORSAR  and  NOAA  mag- 
nitudes. 

Signal  detectability  is  strongly  dependent  upon  site  geology. 
Thus  the  use  of  a few  reporting  stations  in  estimating  event  magnitude  may 
create  bias.  Ringdal  (1975)  and  E-  ernden  (1976)  have  shown  that  the  high 
standard  deviations  of  routine  m.  ( alculations  are  due  to  systematic  varia- 

D 

tions  in  signal  amplitudes  due  to  site  locations.  The  possibility  also  exists 

that  high  signal  variance  may  affect  network  detection  capability.  This  idea 

may  be  evaluated  by  using  range  of  signal  variances  in  NETWORTH.  Veith 

and  Clawson  (1972)  determined  that  a = 0.4  was  representative  of  the 

WWSSN  short-period  network;  this-  value  (a  = 0.4)  was  used  as  the  baseline 

s 

<7.  Tests  were  run  from  a = 0.  2 to  o = 0.  6 (Figures  11-13  and  11-14). 
s s s 

The  network  detection  capability  was  unaffected  by  the  value 
used  for  for  Eurasian  events;  i.e.  , these  events  geographically  interior 
to  the  network.  The  value  used  for  affected  network  detection  capability 
only  for  events  geographically  f.  r removed  from  the  network  interior.  This 
apparently  dichotomous  relationship  can  be  explained  by  referring  to  the  de- 
tector algorithm  used  in  the  NETWORTH  program  (equation  (II- 2)  from 
Table  II- 1).  For  convenience,  hit  algorithm  shall  be  repeated  here. 

- '"n  ^ 
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where  <t>  = normal  cumulative  probability  functior. 
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ICURE  11-14 


THRESHOLD  h/.AGNITUDE  (m  : 4.4  -6.8) 

(T  = 0.  6 


Figures  II- 15a  ai  i II- 15b  refer  to  a signal  whose  mean  is 
respectively  above  and  below  th»  detection  threshold  (T).  The  detection  pro- 
bability p_  equals  the  area  unc  jr  the  signal  normal  distribution  beyond  T. 

Obviously  a larger  o will  low  r p incase  (a)  but  raise  p in  case  (b). 

s ij  ''ij  '• 

and  a smaller  will  have  the  reverse  effect.  The  detection  probability 
for  a signal  with  mean  exactly  on  the  threshold  will  be  0.  5 regardless  of  a 

s' 

A chc  nge  in  will  therefore  ; ffert  the  detection  probability  of  stations  re- 
ceiving the  event  signal  above  the  threshold  oppositely  to  stations  receiving 
the  event  signal  below  the  threshold  An  interior  event  will  be  within  detec- 
tion range  of  all  stations;  theref  >re  a gain  in  detection  probability  at  one  sta- 
tion, due  to  an  unexpectedly  lar;  e o :•  small  a , will  be  compensated  by  a los.*- 
in  detection  probability  at  anoth  r station.  The  network  detection  probability 
for  an  interior  event  will  not  be  significantly  affected,  since  it  is  the  sum  of 
products  of  the  station  detection  pr<  babilities.  However,  an  exterior  event  is 
within  detection  range  of  only  a ew  stations;  these  stations  must  all  have  high 
detection  probabilities  to  get  thi  re<  uired  network  probability  of  a detections. 
Since  the  stations  out  of  detectic  i range  cannot  compensate,  this  means  that 
the  effect  of  upon  exterior  < vent  detection  may  be  predicted  entirely  by 
Figure  11- 15a.  These  concepts  were  tested  by  examining  the  individual  sta- 
tion detection  probabilities  for  oifferent  values  of  a . The  results  were  as 

s 

anticipated;  i.  e.  , although  a change  in  impacted  all  station  detection  pro- 
babilities, the  network  probability  of  a detections  was  affected  only  for  dis- 
tant events,  where  capability  de<  re  ised  as  a increased. 

s 

Since  the  detection  capability  for  Eurasian  events  is  the  pri- 
mary interest  in  evaluating  this  network,  a reasonable  conclusion  is  that 

this  network's  detection  capabil-ty  is  insensitive  to  variations  in  a . Note 

s 

that  a distinction  must  be  drawn  between  network  detection  capability  and 
network  magnitude  estimation.  Obviously,  magnitude  estimation  is  adversely 
affected  by  high  signal  variances;  thus  bias  may  exist  between  tie  magnitude 
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estimates  of  two  networks  for  a gi'^en  event.  Yet  the  fact  that  the  actual  de- 
tection capability  is  relatively  vmaffected  by  higher  signal  variance  indicates 
that  the  use  of  station  corrections  in  the  m.ignitude  estimation  procedures 
can  satisfactorily  resolve  magnitude  bias  between  two  networks  due  to  signal 
amplitude  variance. 

4.  Station  Ranking 

In  evaluating  net  vork  detection  capability,  it  is  desirable  to 
estimate  the  individual  station  > ontribution  to  the  network  capability.  This 
will  indicate  which  stations  mu  t bi  improved  to  increase  capability,  and 
conversely  those  stations  whicl  may  be  eliminated  without  significant  loss. 
Two  methods  were  used  to  esti  late  the  individual  station  contribution  to  the 
baseline  network.  The  first  mi  th^d  was  to  output  the  individual  station  de- 
tection probability  at  the  netwoi  k tl  reshold  magnitude  for  each  epicenter. 

The  second  method  was  to  succ  ssively  delete  each  station  from  the  baseline 
network;  the  resulting  increase  in  threshold  magnitude  then  represents  each 
station's  contribution  to  the  baseline  capability. 

The  results  of  both  orocedures  are  shown  in  Appendix  A. 

These  results  have  been  used  to  ra ok  the  individual  stations.  Since  each  sta- 
tion has  maximal  impact  upon  a different  area,  such  a ranking  must  be  qual- 
ified by  an  arei  restriction;  heri  only  the  Eurasian  continent  was  considered. 
A station  was  considered  good  if  it  had  a significant  threshold  detection  pro- 
bability over  a large  area  of  Eurasia.  Using  this  criterion,  it  is  seen  that 
the  first  six  stations  (ALPA,  L.'iSA.  NORSAR,  ANK,  CHG,  and  MUM)  are  of 
approximately  equal  quality.  The  r ext  four  stations  (KSRS,  MSH,  NWDEL, 
and  SHL)  are  not  quite  as  good  but  still  contribute  significantly  to  the  network 
performance.  The  last  three  static  ns  (WH-YK,  RK-ON,  and  TAP)  contribute 
little;  furthermore,  their  detect  on  probabilities  are  too  low  for  these  stations 
to  act  as  a back-up  in  case  a better  station  goes  down. 
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SECTION  m 

A CRITICISM  OF  NET  WORTH  ASSUMPTIONS 


I The  origiaal  NETWORTH  has  been  modified  to  allow  the  user 

to  assign  all  variables,  including  reliability  at  a station  level.  This  allows  a 

■ better  network  evaluation  since  real  networks  are  inhomogeneous.  However, 
there  are  still  some  assumptions  inherent  in  the  NETWORTH  program  which 

I are  questionable.  These  are  as  follows: 

I • NETWORTH  ignores  signal  loss  due  to  waveform  dis -similarity 

across  an  array.  The  signal  amplitude  used  in  NETWORTH  is 
I calculated  from  tables  for  a given  magnitude  and  epicentral 

distance.  The  signal  amplitudes  are  then  the  same  regardless 
I of  whether  the  receiver  is  an  array  or  single  site.  The  array 

gain,  relative  to  the  single  site,  comes  from  the  noise  reduc- 
I tion  due  to  beamforming.  The  noise  statistics  are  input  as 

station  parameters,  although  noise  variations  with  azimuth 
I cannot  be  handled.  The  result  is  that  NETWORTH  evaluates 

arrays  on  the  basis  of  their  noise  reduction  while  ignoring  the 
I signal  loss  due  to  beamforming. 

• The  station  detection  thresholds  in  NET  WORTH,  (SDT),  are 

I not  assigned  on  the  basis  of  false  alarm  rate.  A detection 

threshold  which  may  seem  desirably  low  from  a NETWORTH 
I evaluation  may  yield  a higher  false  alarm  rate  than  the  total 

system  can  tolerate. 

• NETWORTH  assumes  perfect  association  of  station  detection 

■ bulletins  at  the  network  level.  Association  refers  to  the 

" m-1 
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process  of  calculating  the  event  parameters  from  the  relevant 
station  detection  bulletins.  Uncertainties  in  measurement  at 
the  station  level  can  yield  false  associations.  This  problem  is 
compounded  as  the  false  alarm  rate  increases;  hence  there 
exists  an  optimum  false  alarm  rate  for  a given  network.  A 
false  alarm  rate  higher  than  the  optimum  will  result  in  more 
( vents  being  missed  due  to  false  associations  than  gained  by 
lowering  the  threshold  (Sax  and  Shoup,  1974).  Station  detec- 
tion thresholds  then  should  be  set  from  network  considerations. 

Such  considerations  are  neglected  in  NETWORTH.  The  events 
are  laid  out  on  grid  points  and  the  network  detection  probability  for  each  event 
is  calculated.  This  is  seen  to  be  opposite  to  the  real  world  process  of  event 
determination  through  bulletin  association.  If  perfect  bulletin  association  in 
the  real  world  is  done,  then  real  capability  might  approximate  NETWORTH 
capability.  Perfect  association  requires  either  infinite  resolution  in  the  sta- 
tion measurements  or  a false  alarm  rate  low  enough  to  avoid  ambiguity  due 
so  imprecise  measurements.  The  usual  errors  in  azimuth,  ray  parameter, 
possible  gross  timing  errors,  and  mis -identification  rule  out  the  first  alter- 
native. The  second  alternative  is  equivalent  to  the  second  assumption  listed 
above;  i.  e. , the  threshold  must  be  set  on  the  basis  of  the  tolerable  network 
false  alarm  rate.  Since  a lower  threshold  results  in  a higher  false  alarm 
rate,  the  best  way  to  increase  network  detection  capability  is  to  implement 
effective  association  algorithms. 

In  summary,  NETWORTH  consistently  overestimates  network 
capability  because  it  neglects  certain  network  problems.  These  problems 
have  been  addressed  by  others,  primarily  Sax  (1974)  in  his  network  simula- 
tor. Hence  it  is  recommended  that  NETWORTH  be  remodeled  using  these 
concepts. 
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SECTION  IV 

CONCLUSIONS  AND  RECOMMENDATIONS 


The  purpose  of  this  study  was  to  estimate  the  effect  of  certain 
parameters  upon  network  detection  capability.  The  station  detection  thresh- 
old (SDT)  and  the  station  reliability  were  lound  to  be  the  more  critical  param- 
eters. Changing  the  station  detection  threshold  altered  the  network  magnitude 
detection  capability  by  a constant;  this  constant  equalled  the  logarithm  of  the 
ratio  of  the  two  thresholds.  The  relative  ranking  of  the  individual  stations 
was  unaffected  by  changing  the  SDT  at  a network  level.  Station  reliability 
was  found  to  have  significant  impact  upon  letwork  capability;  capability  loss 

exceeded  0.4  m^  as  reliability,  (or  percentage  of  station  uptime)  dropped  be- 

2 

low  70%.  Changes  in  the  signal  amplitude  variance  (a  ) had  little  effect  upon 

s 

detection  capability  for  Eurasian  events.  For  events  far  removed  from  the 

network  interior,  detection  capability  decreased  as  increased.  However, 

s 

since  the  network  examined  is  primarily  designed  for  Eurasian  surveillance, 

this  network  can  be  considered  insensitive  to  changes  in  (t  ^ . 

s 

An  analysis  of  the  assumptions  inherent  in  the  NETWORTH 
program  yield  the  following  recommendations  for  future  study: 

• Evaluating  the  effect  of  the  signal  variance  upon  other  networks 
to  determine  if  networks  in  general  are  insensitive  to  the  sig- 
nal variance. 

• Using  a NETWORTH  type  program  to  evaluate  different  sta- 
tion detector  threshold  strategies  (e,  g.  , minimum  cost,  con- 
stant threshold,  constant  false  alarm  rate). 
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Utilizing  the  modified  NETWORTH,  which  allows  parameters 
to  be  changed  at  a station  instead  of  a network  level,  in  order 
to  estimate  more  realistic  network  capabilities. 

Adding  algorithms  to  make  NETWORTH  responsive  to  the  fol- 
lowing problems: 

Signal  losf  across  an  array 
Allowable  ilsc  alarm  rates 

N.  twork  c >a!  ility  lo  ^s  due  to  false  association  of 
station  bulletins. 
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appendix  a 

INDIVIDUAL  STATION  DETECTION  CAPABILITY 


This  appendix  cor  tains  the  results  used  to  rate  the  stations 
contained  in  the  baseline  network.  Two  formats  are  used:  tables  and  contour 
plots.  There  is  a table  for  each  station.  Each  table  refers  to  a block  of 
sixty  five  eoicenters  which  primarily  cover  Eurasia.  Epicenters  are  identi- 
fied by  their  latitude  and  longitude.  The  latitude  range  (15°N-75°N)  is  shown 
across  the  top  of  each  table.  The  longitude  range  (0°E-180°E)  is  shown  down 
the  left  side  of  each  table.  For  a table  L (refering  to  station  L)  the  follow- 
ing data  are  presented  for  each  epicenter: 

(1)  Network  threshold  magnitude 

(2)  Probability  that  station  L will  detect  the  network  threshold 
magnitude 

(3)  Resulting  network  threshold  magnitude  if  station  L v ere  de- 
leted from  the  network. 

It  is  seen  that  (2)  and  (3)  represent  roughly  equivalent  evalua- 
tions of  each  station.  If  a station  with  higher  detection  probability  is  deleted 
from  the  network,  the  capability  loss  is  seen  to  be  greater.  As  an  extension 
of  (3)  the  threshold  contour  plots  obtained  from  deleting  each  station  from  the 
network  follow  that  station's  table;  this  permits  a simpler  visual  representa- 
tion of  each  station's  contribution  to  the  total  network  capability.  The  contour 
plots  are  less  precise,  however,  since  the  contour  is  incremental  in  nature. 
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FIGURE  A-5 

THRESHOLD  IviAGNITUDE  (m.  : 4.4  - 6.8): 

CHG  deli;ted  from  network 
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FIGURE  A-6 

THRESHOLD  MAGNITUDE  (mj^:  4.4  - 6.8) 
MUN  DEU'.TED  FROM  NETWORK 
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FIGURE  A-7 

THRESHOLD  K AGNITUDE  (m.  : 4.4  - 6.8): 
KSRS  DELP.TED  FROM  NETWORK 
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FIGURE  A- 10 

THRESHOLD  MAGNITUDE  (m  : 4.4  - 6.8): 
SHL  DEL]  TED  FROM  NETWORK 
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I TABLE  A-6 


IHDIflOOHL  rUTIOH  DETECtlOH  CUPABILIIT 
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BH-TK 
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0 

E 

U.71 

. 125 

ft. 72 
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9.33 

. >26 

9.  36 

IS 

B 

«.71 

.026 

9.  7 1 

9 93 

.211 

9.1 

9 8 

.250 
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E 
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9.93 
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9.26 
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9.27 
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9.  31 
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*5 

B 
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9.97 
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E 
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FIGURE  A- 11 

THRESHOLD  MAGNITUDE  (mb--  4.  4 - 6.8); 
WH-YK  DELETED  FROM  NETWORK 
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FIGURE  A- 12 

THRESHOLD  MAGNITUDE  (mj^:  4.4  - 6.8): 
RK-ON  DELETED  FROM  NETWORK 
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TABLE  A-7 
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4.44 

.240 
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APPENDIX  B 
NET  2 


NET  2 is  a NETWORTH  computer  program  with  the  following 

modifications: 


(1)  The  signal-to-noise  ratio  required  for  detection  (SDT)  and  the 

2 

signal  variance  (o"^)  may  vary  with  station 

(2)  Amplitude  bias  corrections  may  be  utilized  for  particular  sta- 
tions (all  epicenters),  particular  epicenters  (all  stations),  or 
particular  station  epicenter  combinations 

(3)  The  probability  that  each  station  is  'up'  may  be  input,  the  sta- 
tion event  detection  probability  becoming  the  probability  that 
each  station  can  detect  the  event  if  the  station  is  'up'. 


These  options  require  an  additional  control  card  following  each 
station  card,  the  data  on  this  card  being  pertinent  only  to  that  station  named 
on  the  preceding  station  card.  The  signal-to-noise  ratio  required  for  detec- 
tion (SDT),  the  standard  deviation  of  the  signal  (o’g)*  and  the  station  reliabil- 
ity are  respectively  input  with  format  (3F10.  0).  Blanks  in  the  field  space 
designated  for  a particular  variable,  signal  the  use  of  a default.  The  defaults 
for  the  SDT  and  <r^  are  those  values  input  at  the  network  level  (NETWORTH 
control  cards  A and  S).  The  default  for  the  station  reliability  is  1.0;  i.  e.  , 
the  station  is  considered  always  up.  The  addition  of  amplitude  bias  correc- 
tions involved  correction  of  certain  errors;  the  format  of  the  appropriate 
control  card  is  unchanged.  Thus  the  control  cards  of  NET  2 are  the  same  as 
those  of  NETWORTH  with  the  exception  of  one  card  (per  station);  if  this  card 
is  left  blank,  NET  2 defaults  to  NETWORTH. 
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